Tag

#model distillation

7 articles

Y Combinator’s Garry Tan wants U.S. open-weight AI labs to ‘distill’ frontier models, too

Learn how model distillation works - a technique that allows large, complex AI models to teach smaller, more efficient models how to perform the same tasks. This makes AI more accessible and practical for everyone.

Sep 1121

Kimi K3 trails frontier US models by a wide margin on cyber exploits, and distillation may explain why

Kimi K3 trails leading U.S. models by a wide margin on cyber exploits, with distillation possibly explaining the gap. Experts warn of risks in AI development practices.

Jul 2456

Treasury threatens sanctions after White House claims Moonshot distilled Anthropic’s Fable

Learn what model distillation is, how it works, and why it matters in the AI industry. This beginner-friendly explainer covers the technique used in recent AI controversies.

Jul 2238

Nadella calls out AI labs like OpenAI and Anthropic for banning distillation while training on everyone else's data

Microsoft CEO Satya Nadella criticizes OpenAI and Anthropic for restricting model distillation while training on public data, calling it a 'reverse information paradox.'

Jul 1370

Elon Musk testifies that xAI trained Grok on OpenAI models

Elon Musk testifies that xAI trained Grok on OpenAI models, sparking debate over model distillation practices in the AI industry.

Apr 30114

Elon Musk confirms xAI used OpenAI’s models to train Grok

Elon Musk confirmed in a California courtroom that xAI used OpenAI's models to train Grok through model distillation, a common but legally complex practice in AI development.

Apr 3089

White House accuses China of industrial-scale AI model distillation, commits to intelligence sharing with OpenAI, Anthropic, Google

The White House has accused China of industrial-scale AI model distillation, prompting commitments to intelligence sharing with U.S. AI firms like OpenAI and Anthropic.

Apr 2394